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Abstract 

£>\J ■ A conventional way to handle model predictive control (MPC) problems distributedly is to 

t-H ' solve them via dual decomposition and gradient ascent. However, at each time-step, it might 

not be feasible to wait for the dual algorithm to converge. As a result, the algorithm might be 
needed to be terminated prematurely. One is then interested to see if the solution at the point 
i— I _ of termination is close to the optimal solution and when one should terminate the algorithm if 

a certain distance to optimality is to be guaranteed. In this chapter, we look at this problem 
for distributed systems under general dynamical and performance couplings, then, we make a 
statement on validity of similar results where the problem is solved using alternative direction 
method of multipliers. 



^ '■ 1 Introduction 

43 



Model predictive control (MPC) can be used to control dynamical systems with input and 
output constraints while ensuring the optimality of the performance of the system with respect 
to cost functions [T}{3]. Typically, the way that the control input is calculated at each time- 
step is via applying the first control in a sequence obtained from solving an optimal control 
problem over a finite or infinite horizon. The optimal problem is reformulated at each time 
step based on the available measurements at that time step. Traditionally, a full model of the 
system is required to solve the MPC problem and all the control inputs are calculated centrally. 
However, in large-scale interconnected systems, such as power systems 4-6 , water distribution 
systems [6] [7], transport systems [8], manufacturing systems 9 , biological systems |10| . and 
irrigation systems the assumption on knowing the whole model and calculating all the 

■ inputs centrally is often not realistic. Recently, much attention has been paid to solve MPC 

problems in a distributed way [124418] . The problem of distributed model predictive control 
using dual decomposition was considered in [16] . However, in solving any optimization problem 
when using dual decomposition methods the convergence behaviors of dual iterations does not 
necessarily coincides to that of the primal formulation. Hence, the authors in 17] presented 
a distributed MPC algorithm using dual decomposition accompanied with a stopping criterion 
to guarantee a pre-specified level of performance. The authors only addressed linear coupled 
k>( . dynamics with separable cost functions. 

j_j ■ In this chapter, specifically, we formulate the problem of achieving a control objective co- 

operatively by a network of dynamically coupled systems under constraints using MPC. We 
consider discrete-time nonlinear control systems. We are interested in casting the problem in a 
distributed way and we consider the case where the cost function associated with each system is 
not necessarily decoupled from the rest. Additionally, we are not limiting our formulation to the 
case where the coupling in the cost function is the same as the coupling in the dynamics [161117] . 
We note that a natural method to solve such problems is to use dual-decomposition at each 
time-step and solve the problem iteratively. However, a problem that in implementing the dual 
solution iterations is that generally one cannot make any statement on how close the solution is 
to the optimum if the dual algorithm is terminated prematurely. That is, there is no termination 
guideline to ensure that the variables obtained from the dual algorithm are within an acceptable 
bound for the primal problem. In this chapter, we propose such termination guidelines that indi- 
cate how many iterations are needed to ensure a certain suboptimality guarantee, i.e., distance to 
optimality. We extend the results of [17] and present a more general frameworks, i.e., nonlinear 
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interconnected dynamics and cost functions. A way to achieve better numerical properties for 
solving distributed MPC is to apply alternating direction method of multipliers (ADMM) [19] . 
Recently, optimal control synthesis and MPC via ADMM has gained some attention |20II21] , 
However, to the best of our knowledge, no attention has been paid to distributed MPC using 
ADMM. Hence, we show how to address distributed MPC via ADMM and how guarantees on 
termination errors can be obtained. We illustrate the applicability of our results on a formation 
of nonholonomic agents which employ distributed MPC to acquire a desired formation. 

The outline of this chapter is as follows. In Section [2] we formally define the problem of 
interest in this paper and particularly present the plant model and the performance criteria we 
consider. In Section|3]the suboptimality guarantee for the dually decomposed MPC is presented. 
Additionally, we make some comments on finding similar guarantee when the problem is solved 
via ADMM. We show the applicability of the results obtained here to the problem of controlling a 
formation of nonholonomic vehicles in Section[4] Finally, some concluding remarks are presented 
in Section [5] 

1.1 Notation 

The sets of real and integer numbers are denoted by R and Z, respectively. For any m,ri2 £ 
Z U {±oo}, we define Z^"J = {n £ Z | m < n < 712}. When ni = +00, we use Z> ?11 . For any 
x £ R, we also define M,> x = {y £ R | y > x}. Other sets are denoted by calligraphic letters, 
such as X and £. 

Each (directed) graph is a pair of sets as Q = (V, £), where V is the vertex set and £ is the 
edge set. Each edge in the edge set £ is an ordered pair of vertices, e.g., (vi, W2) £ £■ 

2 Problem Formulation 

2.1 Plant Model 

Let a directed graph Q p = ({1, . . . , TV}, £ p ) be given. Consider a discrete-time nonlinear control 
system composed of TV subsystems, where, for each 1 < i < TV, subsystem i can be described in 
state-space form as 

Xi[&+1] =fi(x j [jfe],v i [jfe];ui[ft]), (1) 
with state vector Xi[ft] £ Xi C R' 1 * and control input Ui[k] £ Ui C R m * for given integers 
rii,mi > 1. In addition, let Vi[k] = (xj [k])^ ■ i)^s p R (j-*> e£P n ° denote the tuple of the state 
vector of all the subsystems that can influence subsystem i through its dynamics. For each 
1 < i < TV, mapping fj : Xi X Ylij i)es F 'X Ui ^ Xi determine the trajectory of subsystem i 
given the initial condition Xi[0] £ Xi and the inputs. 

2.2 Performance Criterion 

Let a directed graph Q c = ({1, . . . , TV}, £ c ) be given. For each time-instance k £ Z>o, we 
introduce the running cost function 

00 JV 

J k ((xi[fc])£ i; (ui[* : +oo])£i) =^I]^( x iW.w i [t];u i [t]), 

t—k i—1 

where Wi[k] — (xj ■[&])( J ■ i)^e c ^ R^(3.*)e fC " 3 denotes the tuple of the state vector of all the 
subsystems that can influence subsystem i through its cost. Note that for the described dy- 
namical system, given the control sequence (ui[k : +00])^ and boundary condition (xj[&])i=i! 
the trajectory of the system (xi[k : +oo])jLj is uniquely determined by the described sys- 
tem dynamics in |T]). Hence, we do not explicitly show the dependency of the cost function 
Jfc ((x^A:])^!; (ui[k : +00])^-!) to the trajectory (xi[fe + 1 : +oo])JLi- We make the following 
standing assumption concerning the cost function which is crucial for proving stability of the 
origin for the closed-loop system with a MPC controller in feedback interconnection. 

Assumption 2.1 For each 1 < i < TV, £i : Xi x f}^ i) 6 gc Xj x Ui — >• R>o is a mapping such 
that (a) £j(xj,Wj; Uj) is continuous in Xi for all Xj £ Xi and (b) £j(xj, w>; Ui) = if and only if 
x, = 0. 
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2.3 MPC 

In each time instance k G Z>o, the objective of the designer is to solve an infinite-horizon optimal 
control problem given by 

(u*[k : +oo])^! = arg min J k ( (x^A])^; (iii[k : +oo])^ =1 

(a i [k:+o ])f> =1 v 

subject to ki[t+l] = fc(xi[t], Vi[t];\ii[i\), 1 < i < N,V t G Z> fc , 

xi[&] =Xi[&], 1 <* < N, (2) 
Xi[t] G Xi, l<i< N,Vt£ Z> fe , 

fi*[t] eUi, i<i< Nyte z> fc , 

where (xi[fc : -l-oo])^! is the state estimate initialized with the state measurement Xi[fc] = Xi[fc], 
for all 1 < i < N. Note that we use x; and iii to emphasize the fact that these variables 
are forecast variables and are predicted using the systems model. We relax the infinite-horizon 
optimal control problem in ^ into a finite-horizon optimal control problem given by 

(u*[k:k + T])ti= arg min jf ) ((xi[k])$Li; ( Ui [fe : k + T])? =1 ) , 

(tLi[k:k+T])f =1 V ' 



subject to Xi[t + 1] = fi(xi[i],Vi[t];Ui[t]),l < i < TV, V t G 



7 <fc+T 



Xiffc] =Xj[fc], 1 <i< /V, (3) 
Xi[t] G Xi, l<i<N,\/t£ lfl +T , 
elk, 1 < i < N,Vt G Z|£ +T , 



where 



t=fc i=l 

and T G Z>o denotes the horizon of estimation and control. After solving this optimization 
problem, subcontroller i implements u»[fc] = u*[fc], for each 1 < i < N. Doing so, the overall 
cost of the system equals 

oo JV 

Jo ((x4o])£L i; (u4o : +00])^) = 1 £ 1 ££ i (x i [t],m[t};u i [t}), 

t = i=l 

where the control sequence (ui[0 : +oo])fL 1 , as described earlier, is extracted step-by-step from 
the optimization problem in (|3} . For the MPC problem to be well-posed, we make the following 
standing assumption: 

Assumption 2.2 The optimization problem 

k+T N 

arg min ^ ^£j(xi[f], w<[t]; u»[t]), 

("i[ fe: +°°])fLi t=k j=1 

subject to Xj[i+1] = fc(xi[t], Vi[i\; Ui[i\), l<i< N,V t G Z|* +T , 
Xi[fc] = Xj[fc], 1 < i < JV, 
Xj[t] G A}, l<i</V,VtGZ|£ +T , 
£W„ 1 < i < JV,Vt G Z|£ +T , 

admits a unique global minimizer for all time horizon T G Z>o U {oo}. 

Assumption 12.21 is evidently satisfied if, for each 1 < i < JV, (a) mapping £j : x 

ri(j i)ee c "^i R>o is quadratic, and (b) mapping fi : Xi x Yl(j i)ee p xUi Xi is 

linear [55]. We can also consider strictly convex mappings £4 : Xi x Y\.{j i)ee c x Mi K>o 
when working with finite-horizon cases |23j . 



3 Main Results 

Formulating a constrained optimization problem as a dual problem, in some cases, enables us 
to solve it in a decentralized manner across a network of agents. Typically, each iteration for 



3 



solving the dual problem involves broadcasting and receiving variables for each agent. The 
variables that need to be communicated between the agents are the variables appearing in the 
cost function and the variables (Lagrange multipliers) used to enforce the constraints. In the 
rest of this section, we first cast the MPC problem in a dual decomposition framework and then 
introduce our result on guaranteeing the performance of the iterations to solve the decomposed 
problem distributedly. 

3.1 Dual Decomposition 

Let us, for each 1 < i < N, introduce slack variables Vj[fe] G ffi^(:M)££ p 71 J and Wj[fc] G 
R^--(3,i)e£ c " 3 . Doing so, we can rewrite the finite-horizon optimal control problem in (J3]) as 

k+T N 

{u*[k:k + T])» =1 = argmin £ ^ £i(±i[t], Ui[t]), 

subject to ij[t + l] = {i(xi[t],Vi[i\;ui[i\),l <i<N,\/t£ Z|£ +T , 
ki[k] = Xi[fe], 1 < i < N, 
Xi[t] G 1 < i < N,Vt G Z|£ +T , 
iii[t] €Ui, 1 < i < N,Vt G Z|£ +T , 

wi[t] = w 4 [t], i < » < N,Vt e z|£ +T , 

Vj[t] = Vi[t],l < i < AT,V* G Z|£ +T 
We can incorporate the set of constraints Vi[t] = Vi[i] and w»[t] = w»[t] into the cost function as 

k+T N r 

£i(xi[t],vri[t];ui[t]) 

(4) 

+ Ai [i] T ( v, [t] - v, [t] ) + /Xi [t] T ( w, [t] - w, [t] ) , 



max min > > 



where, for each 1 < i < JV, variables (Aj[fe : k + T], fii[k : k + T])fL 1 denote the Lagrange 
multipliers A<[t] = (Aij[t]) , i)e£ p G R E 0.0« P and = (/i, l3 [t]) (j , )e£ c G R E «.*>« cnj , 
for all k < t < k + T. Note that in @ we dropped the time index of the variables in the 
subscripts of the minimization and maximization operators to simplify the presentation. We can 
rearrange the cost function in ([4]) as 



>^ min >^ 

i=l t=k 



N k+T , 

i (Xi [t] , w, [t] ; u, [t] ) + Xi [t] ' v, [t] + fit [t] 1 w, [t] 

1 

Using ©, we can separate subsystem cost functions, which allows us to develop a distributed 
scheme for solving the finite-horizon MPC problem in Q. This distributed scheme is presented 
in Procedure [T] 

3.2 From Infinite to Finite Horizon 

Let us introduce the notations 

V k {(Mk])ti) = min J k ((Xi[k])f =1 ; (u# : +™])f=i) , 

and 

VP((Mk])li) = min jf> ((x#])f =1 ; (fli[* : - 

(uJfc^+T])" j V / 

subject to the constraints introduced the infinite-horizon optimal control problem in ([2]| and the 
finite-horizon optimal control problem in ©, respectively. 

Theorem 3.1 Assume that there exist an a priori given constant a G [0,1] and controllers 
4>i : n»=i Mi> suc h that, for all (x,[Ai])£Li G Yii=i %i> we have 

N 

\4 (T) ((x4fc])f =1 ) > ^((^[fc + lD^J + a^^fxiW.Wilfclj^axilfcDJLO). (6) 
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Procedure 1 Distributed algorithm for solving the finite-horizon MPC problem J3} 



Input: Xj[fc], 1 < i < N 
Output: Ui[k], 1 < i < N 

Parameters: Iteration numbers {Sfc}^L and gradient ascent step sizes {h^"\ }f° s=0 
for k = 1,2,... do 

- Initialize Lagrange multipliers (A^ 0) [k : k + T] , fif [k : k + T])f =1 . 
for s = 1, 2, . . . , Sfc do 
for i = 1, 2, . . . , N do 

- Solve the optimization problem 



(u^lk-.k + Tlv^lk-.k + Tlwi^lk-.k + T]) 



= arg min L;(u 4 [£: : k + T], v,[fc : k + T] , w, [k : k + T}) 

subject to Xi[t + 1] = f<(xi[t],Vi[*];ui[t]),Vt e z|£ +T , 
X; [fe] = X; [fc] , 

Xi [t] e^vte z|£ +T , 
u 4 [t] eUi,vte z^ k k +T , 

(i,i)e£ p 

wi[t]e n ^,vtez|£ +T , 



where 



fc+T 

Li( Ui [fc : k + T],Vi[k : k + T],Wi[k :k + T])= E 

t=k 



ii ( Xi [t] , w, [t] ; Ui [t] ) + A! s) [i] T v< [t] 



+,*(' ) [t] T w i [t]- E 4:iM T ^M- E ^M T ^M 

(i,j)e£ p (i,j)e£ c 



end for 

- A< s+1) [i] = A< s) [t] + ^ s) (v«[t] - vf»[(]), 1 < i < TV.Vi G z|£ +T . 

- m< s+1) [t] = m! s) [t] + 9 S (S) (w, W [t] ~ w? s) [*]), 1 < i < N, V t £ J,f+ T . 
end for 

- Ui[fc] = uf k) [k], 1 < j < N. 
end for 



where Xi[fc + 1] = £(xi[fc],Vi[fc]; 0i((x»[fc])iLi)), for each l<i<N. Then 

aV k ((Mk])li)<V^ T) ((Mk])^i), 

for all (Xi[fc])£i ellti^- 

Proof: The proof is a direct consequence of Proposition 2.2 in [24] . when V(-) in [23] is 
chosen equal to v£ T \-) above. ■ 

This theorem illustrates that by solving the finite-horizon optimal control problem in @ , we 
get a sub-optimal solution, which is in a vicinity of the solution of the infinite-horizon optimal 
control problem in ([2]) if a is chosen close to one. Hence, in the paper, we assume that the 
horizon T is chosen such that it satisfies (JUJ). fn that way, we do not lose much by abandoning 
the infinite-horizon optimal control problem for the finite-horizon one. 

3.3 Convergence 

Generically, in solving any optimization problem, if one resorts to use dual decomposition meth- 
ods the convergence behaviors of dual iterations does not necessarily coincides to that of the 
primal formulation. In other words, if one terminates the dual iterations after Sk steps and 
obtains the decision variables, one cannot make a statement on how close is the primal cost 
function evaluated at the obtained variable to its optimal value, i.e., the optimality gap cannot 
be determined. However, for model predictive control one can find a bound on such a distance. 
We aim to propose a way to calculate the optimality gap for general distributed MPC problems 
based on the results proposed by [T7] . 
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Let us introduce the notation 

k+T N r 

vP^\(Mk])li) = EE UMt],^ (s) [t]-M s) [t}) 

i = fc i—1 L 

+ A 4 w M T (v«[t]-v 4 [t])+/iW[t] T (w 4 w [*]-Wi[t]) 

where (uf 5 [fc : k + T], v; (s) [fc : k + T], Wi (s) [fc : k + T])f =1 is extracted from Procedure 1. 

Theorem 3.2 Let {Vk}kLo be a given family of mappings, such that, for each k G Z>o, 14 : 
n i=1 A", — > K>o satisfies 

V k ((Mk])ti)>Vr } ((Mk])li), (7) 
/or oZZ (xi[fc])ili G 11=1 I n addition, let iteration number Sk in Procedure^ in each time- 
step k G Z>o, be given such that 

N 

vj; T) ' {Sk \(Mk])i=i) ~ Vfe+i((x»[fc + 1])£0 > e[fc] +aE^(^W,Wi[fc];uf fe) [fc]) (8) 

/or a given constant a G [0,1], where Xj[fe + 1] = ft (x, [fc], v, [fc]; u^ 5 *"- 1 [fc]), /or eac/i 1 < i < N. 
The sequence {e[k]}^L is described by the difference equation 

N 

e[k] = e[k- 1] +o^<,(x,[t - l],Wi[fc - l];ui[fc - 1]) 

+ ^.((^[feD^o - T4-i((x4fc - i])£i), 

/or a// A; G Z>2 and 

e[l] =a^2i i (x i [0),w i [0]; i*[0]) + ^((^[l])^) - ^^((x^O])^), 
i=i 

and e[0] = 0. Then 

aJ ((x,[0])£ x ; (u,[0 : +00])^) < V ((xi[0])? =1 ). (9) 

for any initial condition (xj[0])£Li € 11^=1 ^ n addition, if Vo((xi[0])|Li) < 00 /or <mm/ initial 
condition (x^O])^! G I~Ii=i ^ en 

lim Xi[fc] =0, 1 < i < JV. 

fc— >oo 

Proof: The proof of this theorem is a generalization of the proof of Theorem 3 in [17]. First, 
by induction, we can prove that 

fc-l JV 

4k] = a^^f,(x,W,w,[t]; Ul [t]) + Vi((x,[fc])£i) - V {TUSo) ((M0])li) ■ (10) 

i=0 i=l 

Substituting (|10|l inside P). we get 

k N N 

a E E ^ ( Xl M ' Wl W 5 Ui[*]) = e[A;] + a E £ 1 ( Xl M ' Wl M ' ) M ) 

t=0 i=l i=l 

- Vfc((x(tfc])£i) + ^'^^((xitODilr) (11) 

< ^'^'((^[fcD^o - v k+1 ((Mk + i])£i) 

- v k ((Mk])?Li) + F o (T) ' (So) ((x40])f=i). 

Considering condition Q, we have 

v>((x4fc])f =1 ) > ^((xiifcDilo > y( T ^ s ^(( Xl [fc])f =1 ), 



G 



where the right-most inequality is a direct consequence of standard duality properties. Therefore, 
we can simplify into 



JV X 

i=l 



a^]>>( x 'M> w >M; u 'M) <K ) (T),(So) ((x l [o])£ 1 )-v' fc+ i((x l [fc + i]; 

t = i = l 

<Vo (T) ' (5o) ((**[o])SLO 
<v (T) ((«i[o])iLi) 

< ^((xilO])^), 

where the last inequality is consequence of the observation that longer planning horizons results 
in larger cost functions (due to the lack of terminal cost or constraints) 17] . Hence, we get 

k N 

aJ ((x40])£ i; ( Ul [0 : +00])^) = lim a g £ ^( Xi [i], Wi[t]; u,[t]) 

i=0 i=l 

< Vb((x([0])iLx). 

The proof of the second part is done by a contradiction. Assume that there exists an index j 
such that Xj [k] does not converge to the origin as k goes to infinity. Because of Assumption 12.11 
it is easy to see that there exists a strictly increasing sequence of time-steps {k T }^Lo such that 
(.j(xj[k T ],Wj[k T ];Uj[k T ]) > e > for all r G Z>o. Note that we can always construct such 
a sequence by enforcing the condition |[x 3 4 [fc T ]|| > e' > for all r G Z>o (because otherwise, 
linifc^oo Xj[fc] = 0). Hence, we get 

k N 

aJ (( Xi [0])ti;(ui[0 : +oo])ti) = Um aV VA(x,[(],w,[f];u,[t]) 

\ / k — ^ 00 

t=0 8=1 

M 

> lim aV^Xj^Wj^tuj^]) 



M— s-oo 

r=l 



M 

> lim >^ at 

Af->-oo ' 



T = 

= lim ae(Af + 1) = +00. 

M-tco 

This contradicts the boundedness of Vo((xi[Q])£L:L). Q ■ 

Theorem l3.2l shows that, provided that {Sfc}J*l guarantees (|SJ), the cost of the sub-optimal 
controller extracted from Procedure [T] is in a close vicinity of the global optimal controller, i.e., 
the cost of the sub-optimal controller is never worse than 1/a times the cost of the global optimal 
controller. In addition, the closed-loop system is stable. 

Now, we only need to present a mapping Vk{-) that satisfies condition (0. We use the 
method presented in |17| for generating a reasonable upper bound. Let us introduce the one- 
step forward shift operator q T : (I"Iili^) T+1 ~~ (liili^) T+1 ! so that for any control sequence 
(m[0 : T])? =1 G (IX=i W t ) T+1 we have 

q T ((u40:T])iLi) = (i4[0:T])iL lj 

where 

uj[t] = 

for all 1 < i < N. Now, for any time-step k G Z>i, we can define 



Ui[t+1], 0<t<T-l, 
0, t = T, 



V k ((Mk])li) = Jk (( Xl [fc])il i; q T (u l (Sfc - l) [fc - 1 : T + k - 1] 

where the control sequence u' Sfc ~ 1 ' [k — 1 : T + fc — 1] denotes the control actions of step k — 1 
extracted from Procedure [1] For this described function, it is easy to check that 

^((x^DilO = jf > ((x l [fc])iI 1 ;q T (u< Sfc - l) [fc - 1 :T + fc - 1])) 
because the control sequence qy({fti [ijjjjjt] 1 ) might not be optimal for time-step k. 



Hence, we have proposed a suitable mapping for Theorem 13.2 
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Procedure 2 Distributed algorithm for solving the MPC problem ||3} via ADMM 



Input: Xj[fc], 1 < i < N 
Output: Ui[k], 1 < i < N 
for k = 1,2,... do 

- Initialize scaled dual variables ("yj 
for s = 1, 2, . . . , iSfc do 
for i = 1, 2, . . . , JV do 

- Solve the optimization problem 



■T] 



k + T 

: arg min > 

yi [fc:fe + T] t=fc 



i(y*[*]) 



end for 

- << s+1) [t] = n Ci[t] ( yi [t] + 7 | S) W), i < < < AT.Vt e : 

-7- '[*]:= 7. 
end for 

- Ui [fc] = u^ 5fe) [fc], 1 < i < N. 
end for 



,<fc+T 



\\yi[t] 



■7j 



Wr 



{nCi[i](') i s a projection onto Cj[i]} 



r [t] + (yiW - Cl S+1) [*]), 1 < i < N, V t 6 zf k h 



<k+T 



3.4 ADMM Formulation 



A way to achieve better numerical properties for solving distributed MPC is to apply ADMM, 
which retains the decomposability of the dual formulation while ensuring better convergence 
properties in terms of speed and stability |19| . Recently, solving MPC via ADMM has gained 
some attention .20 . In what comes next, we cast the problem introduced in this chapter in an 
ADMM framework and give a sub-optimality guarantee for this scenario. 
We rewrite the MPC problem proposed in Section \2. 31 



(12) 



(13) 



k+T N 

(■a*[k:k + T})ti= arg min EE^M)' 

(.adk-.k+T))^ t=k i=1 

subject to y l [t] e d[t], 1 < i < N, V t e %f k k +T 
where, for each k < t < k + T, y<[t] = [x4t] T , w;[t] T , u; [i] T , v;[t]] T , and 

&[t] = |[x l [t] T ,w l [t] T ,u l [t] T ,v l [t]] T | Xi[s + 1] =fi(x < [s] ) v j [s];ui[s]) ) x t [s] e X i: 

\ii[s] G Hi, w,[s] = Wi[s], Vi[s] = Vi[s], V s e Xj[fc] = Xi[fc] 

Provided that d[t] is convex for all t £ Z^ +T , then (|12p is equivalent to 

k+T N 

(u*[k:k + T])? = i= arg min £ £ [*(*[*]) + <MC4*D] , 

subject to yi[i] = CiM, 1 < » < AT, Vie Z|£ +T 

where V'c i [t](') is an indicator for Ci[t], viz. i/^. [ t ](z) = if z € Ci[i] and ipa[t]{ z ) = +°° 
otherwise. The augmented Lagrangian for this problem is 



L(( yi [k : k + T])ti, (Ci[fc : fc + T])Zn hi[k : k + T])f =1 ) 

k+T N r 



= EE 



4(yi[t]) + ^i(Ci[*]) + 1 l|y*W - Ct[t] -7i[*]||- 



(14) 



where 7j[t], 1 < i < .2V, are the scaled dual variables. We outline a distributed procedure that 
solves the problem in Procedure [21 

Now, we reintroduce the following function for solving the MPC problem via ADMM: 



V 



(T),(s) 



k+T N 



(( Xi [fe])£ 1 ) = EE 



?i(y^M) + f ||y! s) M-c! s) [i]-7j s) M| 



^ IL»r 



For the case that 1 1 y i s ' ) [*] ~ Ci^M — 7i S 'MI| 2 is l ess than a given threshold £ <C 1, one might 
be able to follow the same line of reasoning as in Theorem 13.21 The next proposition can be 
seen as a simple example of such results. 
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Proposition 3.3 Assume that, in Procedure^ for any time-step k G Z>o, we have 

lim v; (T) - (Sfc) ((x4fc])f =1 ) = v; (T) ((x4fc])f =1 ). (is) 

£et {Vfcj^Lg be a given family of mappings V k : n =1 Xi — > R>o /or k G Z>o. /n addition, let 
iteration number S k in Procedure^ in each time-step k G Z>o, be given such that 

%((xi[fc])£i) > ^'^((x^DiLi), (16) 

and 

N 

VP' (S "\(Mk])li) ~ V k+1 ((Mk + l])li) > e[k] + a£€ i (x#],w i [fc];u< s * ) [fc]) I (17) 

i=l 

/or a given constant a G [0,1], where Xj[fc + 1] = fi(xj[fc], Vj[fc]; [ft]), /or eac/i 1 < i < iV. 
Tfte sequence {e[fc]}^L is described by the difference equation 

N 

e[fc] = e[k- 1] +a^£ i (x i [fc - l],Wi[fc- l];ui[fc - 1]) 

+ ft((x,[fc])£i) - t4_i(( Xi [fe - 1])^), 

/or oZZ A; G Z>2 and 

N 

e[l] = a^4(xi[0], Wi[0]; u,[0]) + ^((^[l])^) - V r (T) ' (So) ((x i [0])£ 1 ), 

i = l 

and e[0] = 0. Then, for any initial condition (x.i[0])fL 1 G YliLi an d an V given constant e > 0, 
there exists So G Z>i smc/i i/iaf 

aJ ((xi[0])jL i; (i*[0 : +00])^) < Vq((*40])^i) + e. (18) 



Proof: Similar to Theorem 13.21 we can prove that 

k N 

a£E £ *( x< M> w *M;uiM) < i/ (T) ' (So) ((x4o])f =1 ). 

(=0 i = l 

Now, noticing that lim So -+ o V / (T) ' (So) ((x 4 [0])iI 1 ) = V (T) ((xj[0])ili), the rest of the proof fol- 
lows. □ 
■ 

Note that in general it is not easy to verify condition (|15f) . However, we believe it is interesting 
to be able to provide guarantees for the closed-loop performance of distributed MPC in the case 
where condition (I15|) holds. 

It is important to show that, for an appropriate family of mappings, we can satisfy condi- 
tion (|16|) with finite number of iterations. Let us use a similar approach as the one we used 
in Subsection 13.31 for calculating a family of mappings {14}^!. Doing so, for each time-step 
k G Z>i, we define 

^((x^DilO = J k ((x I [fc]) l i I 1 ;q T (uf fe - l) [fc- 1 :T + fc-l])) + tf fe , 

where the sequence {i9fe}JL is fixed and such that > for all k G Z>o. Hence, we 

get V k ((Mk])fLi) > V m ((Mk])ti)- Considering that lim s _> +00 V k {T) ' (s) ((x*[fc])£i) = ^ (T) 
((xi[fc])fli), there always exists S' k G Z>o such that 

V k ((Mk])^i) - v (r) ((x,[fc])f.,) > Vf ^((^[fc])^) - V (T \(Mk})^i), (19) 

for all s > S' k . Note that the inequality in (|19jl is equivalent to the inequality in (|16[1 . The 
sequence {i9fe}JL is a design parameter. If are chosen relatively small, it is difficult to 
satisfy (|16|l with a few iteration, whereas if -& k are chosen relatively large, it is difficult to 
satisfy (|17|l because e[k] would become large. 
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Figure 1: Trajectory and control signal of two vehicles when using Procedure ^ and termination law described ir 
Theorem [321 




10 20 30 40 50 60 70 80 90 100 
Figure 2: Iteration numbers S/, versus time-step k for the simulation results in Figure [T] 



4 Simulations 

In this section, we portray the applicability of the algorithm to a formation acquisition problem. 
We assume that the nonholonmic vehicle i, for each i = 1, . . . , N, can be described in state-space 
representation as 

Xi[k + 1] =Xi[k] + 

where Xi[fe] = [ 2^1 [fc] £1,2 [k] ] T G R 2 is the position of the vehicle, v;[fc] £ K is its velocity, 
and 9i[k] G R is its steering-wheel angle. Because of the vehicles' mechanical constraints, i.e., 
bounded speed and steering angle, we assume that the control inputs should always remain 
bounded as < Vi[k] < 0.5 and — n /® f° r au & ^>o- We define each vehicle control 

input as Ui[k] = [ v;[fc] 9i[k] ] T . Let us start with two vehicles. At each time-step k G Z>o, 
these vehicles are interested in minimizing the cost function 

2||xi[t] - xa[t] - di 2 ||a + 10(»?[t] + v 2 2 [t]) , 

where di2 = [ 2 1 1 ' . Let us fix the starting points of the vehicles as 
Xl [0] = 

We also fix the planning horizon T = 5. We use Procedure Q] to calculate the sequence of 
sub-optimal control signals when the termination law (i.e., iteration number Sk) is given by 
Theorem 13.21 Figure [1] illustrates the trajectory and the control signals of both vehicles with 
finite-horizon planning when the sub-optimality parameter is fixed at a = 0.5. To be precise, 
Figures QIa,b) portray different coordinates of the vehicle position while Figures [ljc,d) illustrate 
the velocities and steering-wheel angels of the vehicles, respectively. The red color denotes the 
first vehicle and the blue color denotes the second one. The portrayed simulation is done for 200 
time-steps. It is interesting to note that over the first 100 time-steps, in average 1.25 iterations 
per time-step were used in Procedure [T] to extract the sub-optimal control signal (see Figure [2]). 



Vj[&] cos(6>i [fe]) 
Vi[A] sm(0i{k]) 



Jf ) ((x l [fc]) 2 = i;(u l [fc:fc + T]) 2 =1 ) = E 
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Figure 3: Trajectory and control signal of two vehicles when using a centralized optimization algorithm. 
Table 1: Sub-optimality ratio as function of a. 



a 


0.1 


0.3 


0.5 


0.7 


P 


9.7875 


3.2725 


1.9684 


1.4198 



Figure [3] illustrates the trajectory and the control signals of both vehicles with finite-horizon 
planning using a centralized optimization algorithm as a reference. We also check the influence 
of q. To do so, we introduce some notations. For each time-step k, we define (uf rlmal [ 
(ui[fe])f =1 where 



(vu[k :k+T])l 



arg mm 

(a i [k-.k+T]eu i ) : l =1 



4 T \(x i \k])tu(Mk--k + T])ti)- 



Similarly, we define (uP ual [fc])f =1 = (u[ Sk [fc])f = r where, for each vehicle, u' [fc] is calculated 
using Procedure [1] when the dual decomposition iteration numbers {S^'kLo is extracted from 
Theorem 13.21 Now, we define the ratio 

_ 4 H) ((x i [0])Li;(u? u ' il [0 = -g])Li) 
9 4 H) ((x40])f =1 ; «^[0 : H])U) ' 

where H is the simulation horizon. Table [T] shows p as a function of a for H = 1000. Based 
on this table, we can numerically verify the claim of Theorem 13.21 that using Procedure [T] when 
the dual decomposition iteration numbers is extracted from (JSj) provides a suboptimality ratio p 
that is inversely proportional to the design parameter a. 

These simulations can be readily extended to more vehicles. FigureUillustrates the trajectory 
and the control signals of three vehicles when trying to minimize the cost function 



4 T) ((x, 



with 



k + T 

3 i=1 ;(u i [k:k + T]) 3 i= i) = Y l 

t—k 



2l|xi[*]-x 2 [t]-d 12 ||! + 2|lxi[t]-x 3 [t]-di 3 |]! 



+ 2||x 2 [i] - x 3 [t] - das || a + 10(w?[t] + v%\t] + v\\ 



' +1 " 




' -3 " 




' -4 " 


-5 


, di3 = 


. + 2 . 


, d 2 3 = 


. + 7 . 



Let us fix the starting points of the vehicles as 



xi [0] 



-4.0 
-1.0 



x 2 [0] 



-1.0 
-3.0 



x 2 [0] 



-2.0 
+3.0 



We consider planning horizon T = 3. As before, we use Procedure [T] to calculate the sequence 
of sub-optimal control signals when the termination law (i.e., iteration number Sk) is given by 



11 




Figure 5: Trajectory of the vehicles in the 2-D plane. 



Theorem 13.21 and the sub-optimality parameter is a = 0.2. The red, blue, and green colors 
denotes the first, second, and third vehicle, respectively. Figure [5] portrays the trajectory of the 
vehicles in the 2-D plane. The final formation is illustrated by the triangle in black color. The 
codes to generate the results of this section can be found at [25] . 

We conclude this section by briefly noting that the system consisting of N agents under 
the aforementioned cost function converges to the desired formation if and only if Q c is con- 
nected. This is a direct consequence of the structural rigidity of the desired formation, for more 
information see [2B]. Other cost functions, such as 

fc + T r JV i 

4 T) (( x <M)fci;(ui[fc -k + T\%x) = J2 E (W«]-*iWlla-|l«J«lla) a +E^I*] > 

can be considered as well. In this case, the system converges to the desired formation if and 
only if the formation is globally rigid with N > 4, see [271128] and references therein. 



5 Conclusions 

In this paper, we considered the dual decomposition formulation of a distributed MPC problem 
for systems with arbitrary dynamical couplings. More specifically, we studied the problem 
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of calculating performance bounds on the solution obtained from iteratively solving the dual 
problem in a distributed way when the iterations are terminated after Sk steps at time-step k. 
Later, we commented on how the problem can be cast in an ADMM setting. We demonstrated 
the validity of the proposed performance bound through simulations on formation acquisition by 
a group of nonholonomic agents. As a future research direction, one might consider providing 
better performance bounds for the case where ADMM is implemented to solve the MPC problem. 
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